3D Hand Pose Estimation in Point Cloud Using 3D Convolutional Neural Network on Egocentric Datasets
نویسندگان
چکیده
3D hand pose estimation from egocentric vision is an important study in the construction of assistance systems and modeling robot robotics. In this paper, we propose a complete method for estimating posefrom complex scene data obtained sensor. which simple yet highly efficient pre-processing step segmentation. process, used Hand PointNet (HPN), V2V-PoseNet(V2V), Point-to-Point Regression (PtoP) finetuning to estimate collected sensor, such as CVRA, FPHA (First-Person Action) datasets. HPN, V2V, PtoP are thedeep networks/Convolutional Neural Networks (CNNs) that uses point cloud hand. We evaluate results using preprocessing do not use see effectiveness proposed method. The show distance error increased many times compared estimates on datasets obstructed (the surveillance cameras, viewed top view, front sides view) MSRA, NYU, ICVL quantified, analyzed, shown CVAR dataset projected color image dataset.
منابع مشابه
Hand3D: Hand Pose Estimation using 3D Neural Network
We propose a novel 3D neural network architecture for 3D hand pose estimation from a single depth image. Different from previous works that mostly run on 2D depth image domain and require intermediate or post process to bring in the supervision from 3D space, we convert the depth map to a 3D volumetric representation, and feed it into a 3D convolutional neural network(CNN) to directly produce t...
متن کامل3D Hand Pose Estimation with Neural Networks
We propose the design of a real-time system to recognize and interpret hand gestures. The acquisition devices are low cost 3D sensors. 3D hand pose will be segmented, characterized and track using growing neural gas (GNG) structure. The capacity of the system to obtain information with a high degree of freedom allows the encoding of many gestures and a very accurate motion capture. The use of h...
متن کاملWorldwide Pose Estimation Using 3D Point Clouds
We address the problem of determining where a photo was taken by estimating a full 6-DOF-plus-intrincs camera pose with respect to a large geo-registered 3D point cloud, bringing together research on image localization, landmark recognition, and 3D pose estimation. Our method scales to datasets with hundreds of thousands of images and tens of millions of 3D points through the use of two new tec...
متن کامل3D Hand Pose Detection in Egocentric RGB-D Images
We focus on the task of everyday hand pose estimation from egocentric viewpoints. For this task, we show that depth sensors are particularly informative for extracting near-field interactions of the camera wearer with his/her environment. Despite the recent advances in full-body pose estimation using Kinect-like sensors, reliable monocular hand pose estimation in RGB-D images is still an unsolv...
متن کامل3D Point Cloud Classification and Segmentation using 3D Modified Fisher Vector Representation for Convolutional Neural Networks
The point cloud is gaining prominence as a method for representing 3D shapes, but its irregular format poses a challenge for deep learning methods. The common solution of transforming the data into a 3D voxel grid introduces its own challenges, mainly large memory size. In this paper we propose a novel 3D point cloud representation called 3D Modified Fisher Vectors (3DmFV). Our representation i...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal on Information Technologies & Communications
سال: 2021
ISSN: ['1859-3534']
DOI: https://doi.org/10.32913/mic-ict-research.v2020.n2.936